Spatial and temporal background modelling of non-stationary visual scenes

PhDThe prevalence of electronic imaging systems in everyday life has become increasingly apparent in recent years. Applications are to be found in medical scanning, automated manufacture, and perhaps most significantly, surveillance. Metropolitan areas, shopping malls, and road traffic management all employ and benefit from an unprecedented quantity of video cameras for monitoring purposes. But the high cost and limited effectiveness of employing humans as the final link in the monitoring chain has driven scientists to seek solutions based on machine vision techniques. Whilst the field of machine vision has enjoyed consistent rapid development in the last 20 years, some of the most fundamental issues still remain to be solved in a satisfactory manner. Central to a great many vision applications is the concept of segmentation, and in particular, most practical systems perform background subtraction as one of the first stages of video processing. This involves separation of ‘interesting foreground’ from the less informative but persistent background. But the definition of what is ‘interesting’ is somewhat subjective, and liable to be application specific. Furthermore, the background may be interpreted as including the visual appearance of normal activity of any agents present in the scene, human or otherwise. Thus a background model might be called upon to absorb lighting changes, moving trees and foliage, or normal traffic flow and pedestrian activity, in order to effect what might be termed in ‘biologically-inspired’ vision as pre-attentive selection. This challenge is one of the Holy Grails of the computer vision field, and consequently the subject has received considerable attention. This thesis sets out to address some of the limitations of contemporary methods of background segmentation by investigating methods of inducing local mutual support amongst pixels in three starkly contrasting paradigms: (1) locality in the spatial domain, (2) locality in the shortterm time domain, and (3) locality in the domain of cyclic repetition frequency. Conventional per pixel models, such as those based on Gaussian Mixture Models, offer no spatial support between adjacent pixels at all. At the other extreme, eigenspace models impose a structure in which every image pixel bears the same relation to every other pixel. But Markov Random Fields permit definition of arbitrary local cliques by construction of a suitable graph, and 3 are used here to facilitate a novel structure capable of exploiting probabilistic local cooccurrence of adjacent Local Binary Patterns. The result is a method exhibiting strong sensitivity to multiple learned local pattern hypotheses, whilst relying solely on monochrome image data. Many background models enforce temporal consistency constraints on a pixel in attempt to confirm background membership before being accepted as part of the model, and typically some control over this process is exercised by a learning rate parameter. But in busy scenes, a true background pixel may be visible for a relatively small fraction of the time and in a temporally fragmented fashion, thus hindering such background acquisition. However, support in terms of temporal locality may still be achieved by using Combinatorial Optimization to derive shortterm background estimates which induce a similar consistency, but are considerably more robust to disturbance. A novel technique is presented here in which the short-term estimates act as ‘pre-filtered’ data from which a far more compact eigen-background may be constructed. Many scenes entail elements exhibiting repetitive periodic behaviour. Some road junctions employing traffic signals are among these, yet little is to be found amongst the literature regarding the explicit modelling of such periodic processes in a scene. Previous work focussing on gait recognition has demonstrated approaches based on recurrence of self-similarity by which local periodicity may be identified. The present work harnesses and extends this method in order to characterize scenes displaying multiple distinct periodicities by building a spatio-temporal model. The model may then be used to highlight abnormality in scene activity. Furthermore, a Phase Locked Loop technique with a novel phase detector is detailed, enabling such a model to maintain correct synchronization with scene activity in spite of noise and drift of periodicity. This thesis contends that these three approaches are all manifestations of the same broad underlying concept: local support in each of the space, time and frequency domains, and furthermore, that the support can be harnessed practically, as will be demonstrated experimentally

Multi-use lunar telescopes

The objective of multi-use telescopes is to reduce the initial and operational costs of space telescopes to the point where a fair number of telescopes, a dozen or so, would be affordable. The basic approach is to develop a common telescope, control system, and power and communications subsystem that can be used with a wide variety of instrument payloads, i.e., imaging CCD cameras, photometers, spectrographs, etc. By having such a multi-use and multi-user telescope, a common practice for earth-based telescopes, development cost can be shared across many telescopes, and the telescopes can be produced in economical batches

The FX/90: A proposal in response to a low Reynolds Number station keeping mission

The FX/90 is a remotely piloted vehicle designed to fly at Reynolds numbers below 2 x 10 to the 5th power. Several applications exist for this type of flight, such as low altitude flight of very small aircraft. The design presented here allows investigation into the unique problems involved in low Reynolds number flight, which will, in turn, further understanding of this flight regime. The aircraft will operate in a steady flight environment, free from significant atmospheric turbulence and weather effects. The F-90 has a 39 in. fuselage which is constructed of balsa and plywood. The landing gear for the aircraft is a detachable carriage on which the aircraft rests. The aerodynamic planform is a rectangular wing (no taper or sweep) with a chord of 9 in., a wingspan of 72 in., and is constructed entirely out of styrofoam. The propulsion system is a puller configuration mounted on the front of the fuselage. It consists of an Astro 05 engine and a 10-6 two bladed propeller. Control of the aircraft is accomplished through the use of two movable control surfaces: elevators for pitch control, and a rudder for yaw control. The aircraft is soundly constructed, highly maneuverable, and adequately powered. Furthermore, the investigation into alternative technologies, most notably the styrofoam wing and the detachable landing gear, holds promise to improve the performance of the aircraft

User Interface Design Patterns for Information Search and Discovery

User Interface (UI) Design Patterns are principled solutions to common design problems. Although originally developed and applied within the field of architecture (Alexander, 1977), they have since been applied to fields as diverse as software development (Gamma et al 1994) and more latterly, interaction and user experience design (e.g. Tidwell 2005, van Duyne et al 2006, Scott 2009). This paper examines the role of patterns in designing information search and discovery applications, describes some of the challenges involved in creating the Endeca UI Design Pattern Library (UIDPL), and explores some of the issues involved in maintaining and growing a pattern library as a resource for a company as well as the wider user experience (UX) design community

Candidates for asteroid dust trails

The contribution of different sources to the circumsolar dust cloud (known as the zodiacal cloud) can be deduced from diagnostic observations. We used the Spitzer Space Telescope to observe the diffuse thermal emission of the zodiacal cloud near the ecliptic. Several structures were identified in these observations, including previously known asteroid dust bands, which are thought to have been produced by recent asteroid collisions, and cometary trails. Interestingly, two of the detected dust trails, denoted t1 and t2 here, cannot be linked to any known comet. Trails t1 and t2 represent a much larger integrated brightness than all known cometary trails combined and may therefore be major contributors to the circumsolar dust cloud. We used our Spitzer observations to determine the orbits of these trails and were able to link them to two ("orphan" or type II) trails that were discovered by the Infrared Astronomical Satellite (IRAS) in 1983. The orbits of trails t1 and t2 that we determined by combining the Spitzer and IRAS data have semimajor axes, eccentricities, and inclinations like those of the main-belt asteroids. We therefore propose that trails t1 and t2 were produced by very recent (<~100 kyr old) collisional breakups of small, <~10 km diameter main-belt asteroids

Self-assembled monolayers of omega-functional silanes: A platform for understanding cellular adhesion at the molecular level

Self-assembly represents a powerful and versatile strategy to create substrates with controlled molecular-level physicochemical characteristics. As a result, self-assembled monolayers (SAMs) of silanes continue to find use in a multitude of applications in biotechnology and nanotechnology, both as model substrates to study interfacial interactions and as a strategy to chemically graft bioactive molecules. In our work, SAMs of various functional groups have been used for fundamental studies of cellular interactions with peptides and proteins. Namely, cellular adhesion was quantitatively probed to elucidate the roles of non-specific forces arising from the substrate and to study the specific interactions of cellular receptors with adsorbed extracellular matrix (ECM) proteins, such as fibronectin, and grafted arginine–glycine–aspartic acid (RGD) peptides. Measurements of the cellular detachment strength using a spinning disc apparatus demonstrated that the terminal functionality of the silane SAM used as the substrate exerted significant effects and highlighted the importance of substrate selection in biological applications. Quantitative comparison of the various cellular interactions demonstrated that non-specific interactions can be much larger in magnitude than peptide- and protein-mediated adhesion. As adhesion is the first step in a cascade of events through which cellular interaction with a material surface occurs, this finding has implications on assays of long-term cellular function as well. The insight provided by these studies should help in the development of optimized protein and peptide microarrays, or biochips, as well as better bioactive materials for biomaterial/tissue engineering applications

Case Study: The Conservative Management of a Complex Mid Foot Injury in an Elite Professional Footballer

Lisfranc injuries, often accompanied with tarsometatarsal joint (TMTJ) disruption are not well documented in football despite becoming increasingly more prevalent within other athletic populations. Currently there is a paucity of evidence documenting prognosis, rehabilitation strategy and outcome. The presented case summarises the conservative rehabilitation and return to play of a 26-year-old elite professional footballer who presented with a Lisfranc injury alongside a 3rd TMTJ coalition stress response. Injury was sustained when landing awkwardly from a jump causing the midfoot to be forced into a hyper-plantarflexed position. Palpation identified tenderness over the 2nd and 3rd MT, with a positive piano key test. Magnetic resonance imaging (MRI), computed tomography (CT), stork view x-ray and review from a leading foot and ankle specialist confirmed diagnosis, post contradictory MRI results. Presented is a summary of the assessment process, conservative management of the injury and the resultant rehabilitation process followed, which led to the successful return to play of the athlete

Advantages of the no-scalpel vasectomy technique

The no-scalpel vasectomy (NSV) technique should be used instead of the standard incisional method. (Strength of Recommendation: A, based on systematic reviews, mixed-quality randomized controlled trials [RCTs], cohort studies, and case-control series.) The NSV technique is associated with fewer complications, produces less perioperative and postoperative pain, results in quicker recovery, takes less time to perform, and is as effective as standard incisional vasectomy